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1.   Introduction 

Whenever  cost  parameters  in  standard  inventory  models 
become  difficult  if  not  impossible  to  assess,  one  is  often  forced 
to  examine  criteria  other  than  the  classical  minimum  cost  of  the 
operation  as  a  measure  of  effectiveness.   This  consideration  is 
particularly  pertinent  to  military  supply  systems  wherein  the 
traditional  "out-of-stock"  cost  has  to  be  measured  in  such  intan- 
gible terms  as  loss  of  mission.   On  the  other  hand,  current  budget 
considerations  being  what  they  are,  there  is  a  renewed  interest 
in  controlling  the  "other"  traditional  cost  factor  of  holding 
too  much  stock  to  overprotect  the  out-of-stock  position.   Faced 
with  truly  random  demands  on  the  supply  system,  however,  it  is 
practically  certain  that  one  or  the  other  of  these  two  undesirable 
states  will  have  to  be  tolerated  as  time  progresses.   It  naturally 
follows  that  the  more  accurately  that  random  demand  can  be  pre- 
dicted, the  better  control  one  has  over  the  system.   Indeed,  in 
a  completely  deterministic  model,  where  demands  are  assumed  known 
with  certainty,  it  is  possible  to  structure  models  (as  in  Ref  [5] ) 
so  as  to  never  be  out  of  stock;  the  system  can  then  be  operated 
optimally  with  respect  to  other  parameter  choices  in  a  simple, 
and  fairly  self -regulatory  manner. 

The  problem  of  forecasting  demand  thus  arises  as  a  very 
important  one  in  the  context  of  several  models  presently  employed 
by  NAVSUP.   Several  previous  reports  ( [1] ,  [2]  and  [3])  have 
addressed  different  aspects  of  some  of  the  difficulties  involved 
in  demand  forecasting,  with  special  emphasis  on  statistical 


considerations.   In  particular,  the  method  of  exponential 
smoothing,  initiated  by  Brown  [4]  and  presently  used  extensively 
by  NAVSUP,  has  been  the  focus  of  special  attention  and  analyzed 
in  some  depth  in  those  studies.   The  present  report  continues 
that  general  study  and  provides  some  answers  to  issues  that  were 
raised  and  left  unsettled  in  the  previous  reports. 

One  of  the  problems  associated  with  forecasting  has  to  do 
with  the  variability  of  the  forecasts.   So  much  attention  is  often 
paid  to  the  accuracy  (in  the  expected  value  sense)  of  the  fore- 
cast that  it  is  easy  for  variability  to  become  slighted.   But  in 
fact,  no  matter  how  well  the  scheme  used  forecasts  mean  demand, 
a  large  associated  variance  leaves  the  decision  maker  with  little 
in  the  way  of  control.   This  problem  is  especially  highlighted  in 
traditional  periodic  review  models  where  large  buys  are  made  early 
in  the  period  to  protect  against  what  was  an  accurate  but  extremely 
variable  forecast  that  never  materializes.   The  result  and  unneces- 
sary drain  on  a  constrained  budget  creates  an  obvious  dilemma. 
So,  while  we  would  like  accurate  forecasts,  we  should  equally  well 
look  for  precise  ones  in  the  sense  of  having  a  small  variance. 

In  previous  reports,  an  issue  was  made  over  the  fact  that 
exponential  smoothing,  coupled  with  MAD  as  an  estimate  of  varia- 
bility, seems  to  produce  excessive  variability  in  the  reorder 
levels  even  under  stable  assumptions.   In  the  next  section,  this 
point  is  pursued  further  to  determine  the  extent  to  which  fore- 
casting might  be  improved  upon  within  the  context  of  smoothing  as 
a  technique.   Results  are  given  only  for  the  normal  distribution 


with  a  constant  mean  and  variance.   While  this  is  admittedly  a 
special  case,  it  is  after  all  an  important  one  which  in  fact 
applies  as  a  model  to  a  number  of  inventory  items.   But  more 
importantly,  the  modifications  suggested  for  comparison  were  best 
studied  under  such  controlled  assumptions  to  reveal  the  effects 
on  variability. 

In  Section  3,  the  main  purpose  of  the  present  study  is 
explored.   That  purpose  is  to  examine  the  effects  on  various  fore- 
casting techniques  of  a  changing  mean  value  function.   The  examina- 
tion has  in  turn  come  about  as  a  result  of  suggestions  from  NAVSUP 
that,  while  a  constant  mean  model  may  be  a  valid  assumption  in  a 
given  period  (quarter) ,  that  constant  value  changes  from  quarter 
to  quarter  for  many  different  items  in  the  inventory  system.   Thus, 
while  exponential  smoothing  is  not  an  optimal  procedure  to  employ 
in  a  constant  mean  model  (as  pointed  out  in  [3])  it  may  be  more 
so  in  the  case  of  a  varying  mean.   Indeed,  such  a  case  would 
appear  to  lend  itself  quite  well  to  some  kind  of  adaptive  scheme 
such  as  exponential  smoothing.   Several  alternatives,  along  with 
smoothing  at  two  levels,  are  tested  against  several  different 
models  of  a  changing  mean  demand.   Again,  only  the  normal  case 
is  examined  in  this  study.   For  reasons  documented  earlier,  com- 
parisons are  made  via  computer  simulation  and  the  associated  pro- 
gram elements  are  summarized  in  appendices  to  this  report. 

In  order  to  test  some  of  these  results  with  real  data,  the 
authors  requested  and  received  actual  demand  data  on  10,000 
different  items  for  eight  quarters.   The  analysis  of  these  data 


is  presented  in  Section  4  along  with  the  usual  precautions  against 
overgeneralization  with  such  limited  information.   Finally,  some 
recommendations  for  further  study  are  presented  in  a  concluding 
section  along  with  some  remarks  about  processing  times. 


2.   Variability  of  Smoothing 

In  previous  reports  already  cited  ( [2]  in  particular)  the 
problems  associated  with  forecast  variability  have  been  discussed. 
Special  attention  was  given  to  the  variability  associated  with 
exponential  smoothing  and  MAD  (Mean  Absolute  Deviation) .   This 
section  is  a  continuation  of  that  study  with  special  attention  to 
the  effect  in  particular  on  reorder  levels. 

The  theoretical  basis  for  the  present  discussion  is  the 
following:   Suppose  that  random  demand  in  a  periodic  review  inven- 
tory model  is  normally  distributed  with  constant  mean   y   and 
standard  deviation   a.   Since  both  of  these  parameters  are  typically 
unknown,  they  must  be  estimated  from  data.   Such  estimators  are 
themselves  random  variables  subject  to  fluctuation  and  must,  per- 
force, be  inexact.   Any  application  of  such  estimates  are  then 
subject  to  the  same  inexactness  and,  in  particular,  reorder  levels 
will  be  so  affected. 

It  is  standard  in  these  circumstances  to  adopt  a  reorder 
level  of  the  form   R  =  y  +  Ka   where   K   is  chosen  to  satisfy  a 
given  risk  (stockout)  requirement.   More  specifically,  if   0  <  p  <  1 
is  a  specified  stockout  risk,  then, 

(1)  p  =  Pr(X>R)  =  Pr(X>y+Ka) 

defines   K,   where   X   is  the  random  demand.   Obviously   K   is 
then  the   100 (1-p) —  percentile  of  the  standard  normal  distribu- 
tion and  may  be  found  from  published  tables.   Some  standard  values 
of   K   are  1.23,  1.64,  1.96  and  2.57  associated,  respectively, 
with  risk  values  of  .10,  .05,  .025  and  .005. 


The  fact  that   X   is  random  in  the  first  place  is  what 
forces  us  to  even  consider  a  stockout  risk.   Thus,  even  if   u 
and   a   were  precisely  known,  there  is  no  way  to  guarantee  that 
random  demand  will  never  exceed  a  reorder  level,  wherever  we  set 
it.   Thus,  we  adopt  a  risk  value  that  we  are  willing  to  tolerate 
and  choose   K   to  set  the  reorder  level  accordingly.   The  thing 
that  prevents  us  from  making   p   too  small,  of  course,  is  that 
the  corresponding  value  of   K   increases  as  does   R   and,  if  the 
demand  does  not  materialize,  we  are  left  with  an  oversupply  of 
items  for  which  a  holding  penalty  of  some  sort  must  be  assessed. 
There  is  thus  a  need  for  a  trade-off  between  these  two  opposing 
penalties. 

The  situation  becomes  even  more  complex  when  we  do  not 
know  u   and   a.   Indeed,  however  they  might  be  estimated  by, 
say   u   and  a,      respectively,  the  corresponding  estimated  reorder 
level   R  =  u  +  Ka   is  very  likely  different  from   R.   Two  awkward 
situations  then  arise.   First,  if   R  <  R,   the  theoretical  value, 
the  corresponding  risk  is  inflated,  which  is  to  say 

Pr(X>R)  >  Pr(X>R)  =  p. 

Thus,  the  probability  of  running  out  of  stock  is  greater  than   p, 
the  required  stockout  risk.   On  the  other  hand,  if   R  >  R,   there 
is,  of  course,  a  corresponding  reduction  in  risk  but  only  at  the 
expense  of  overstocking  items  and  paying  the  holding  penalty. 

The  present  study  does  not  address  the  complex  problem  of 
giving  a  utility  value  to  these  two  penalties.   Thus,  it  may 


indeed  be  more  desirable  to  overstock  and  pay  a  holding  cost 
(achieving  a  stockout  risk  even  smaller  than  required)  than  to 
hold  less  stock  and  allow  the  corresponding  stockout  risk  to 
inflate.   The  point  of  view  here  is  that  both  situations  are  to 
be  avoided  if  possible  and  our  main  interest  is  in  the  statistical 
nature  of   R  with  special  attention  to  its  variability. 

There  are,  of  course,  infinitely  many  ways  to  estimate   R 
in  the  given  circumstances.   Unfortunately,  not  all  of  them  pro- 
duce random  variables  whose  probability  distributions  are  mathe- 
matically tractable.   In  particular,  when  exponential  smoothing 
is  adopted  as  an  averaging  technique,  and  when  a   is  estimated 
by  means  of  MAD  as  well,  such  tractability  is  particularly  elusive, 
as  documented  previously.   For  this  reason,  simulation,  with  its 
inherent  inconclusiveness,  was  adopted  in  previous  reports  to 
evaluate  statistical  characteristics.   Additional  efforts  not- 
withstanding, the  intractability  remains  and  simulation  is  again 
used  in  this  report  as  a  basic  tool  for  analyzing  variability. 

When  demand  is  assumed  normal  with  the  same  parameters 
from  period  to  period — certainly  a  very  special  case — a  lot  is 
known  about  the  estimation  problem.   In  particular,  if  maximum 
likelihood  estimates  of   y   and   a   respectively  are  substituted 
(using  the  invariance  principle)  into  the  formula  for   R,   the 
corresponding  estimate  of   R   is  itself  maximum  likelihood  with 
its  attendant  optimum  properties  stemming  from  Gauss-Markov  con- 
siderations.  Consequently,  we  may  use  the  maximum  likelihood 
estimate  as  a  norm  of  sorts  against  which  to  judge  other  estimators. 


To  gain  better  insight  into  the  source  of  variability,  we  will 

here  examine  variations  of  exponential  smoothing  and  MAD  and 

compare  the  results  accordingly. 

In  particular,  we  consider  smoothed  estimates  of   u   and 

a   as  documented  in  previous  reports.   That  is,  if  data   x. ,x~  ,  .  .  .  ,x 

are  given, 

t-1   . 
y  =  a  I      B   x.  .    and 
k=0      t_K 


~   /tt  (2-a)  7"      ,_ 
a  =  \  A     where 


t-1   . 

A  -  a  I      3K|e    |, 
k=0 


et-k   xt-k  '  xt-k-l, 

t-k-2 
*t-k-l  =a  .J   BD  xt-k-l-j- 

In  words,   x   ,_,   is  the  forecast  of   x.  ,   at  time   t-k-1, 
based  on  exponential  smoothing  of  data   x, , . . . ,x   ,  .      using  a 
smoothing  constant  of   a(3=l-a);   e4-_ic   J-s  tne  forecast  error, 
being  the  difference  between  the  actual  demand  at  time   t  -  k   and 
what  was  forecast  one  period  earlier;   A   is  the  exponentially 


*«* 


smoothed  estimate  of  error  MAD  (A  ) .   The  formula  for   a   stems 

from  the  fact  that,  under  the  normal  distribution  assumptions, 

the  error  standard  deviation   (a  )   is  related  to  the  error  MAD 

by  means  of   a   =  /  5-  A^   and  in  turn,    o    is  related  to   a   by 
J         e      2   e  e 

/  2-a 
a  =  /  —j—  o    ,   at  least  asymptotically,  i.e.  for  large  values  of  t 


Basically,  with  these  definitions  in  mind,  NAVSUP  presently 
estimates   R  with  the  formula 

(3)  R  =  y  +  Ka. 

In  the  sequel,  we  will  refer  to  this  as  Method  A, 

In  our  previous  studies,  we  established  that  a  great  deal 
of  the  variability  in   R   stemmed  from  the  excessive  variability 
in   a   and  confirmed  this  by  examining  the  mean  squared  error  of 
a   as  an  estimate  of   a   in  many  cases,  that  is,  over  a  wide 
range  of  parameter  choices.   But,  to  what  extent  is  that  excess 
variability  due  to  the  smoothing  operator  itself  versus  the  use 
of  MAD  to  measure  variability?   To  isolate  these  contributory 
factors,  as  well  as  to  test  the  sensitivity  of  the  results  to 
parameter  choices  (a   in  particular) ,  several  variations  of   a 
were  chosen. 

First,  we  agree  to  use  a  smoothed  estimate  of   y,   that  is 
y   as  defined  in  (2)  to  keep  that  part  of  the  estimate  of   R 
constant  to  each  variation  of  the  method.   Then,  Method  B  is 
defined  by  using  a  squared  version  of  forecast  error  in  place  of 
absolute  value  based  on  smoothing.   Thus,  smoothed  squared  fore- 
cast error  becomes 

t_1   k 

k=0     t  K 

and,  to  convert  back  into  the  unit  of  scale,  the  square  root  is 

taken  and  the  corresponding  estimate  of   a   becomes, 


/N  /\ 


=  /tt.^Y 


,  ^   6   et-k  * 


a  =  a 

k=0 


For  Method  B  then,  the  estimated  reorder  level  is  given  by 

(4)  R  =  y  +  KaB. 

When  compared  to  Method  A,  we  should  see  the  effect  of  absolute 
value  (MAD)  on  the  variability. 

For  our  third  variation,  we  use  ordinary  averaging  on 
squared  forecast  error  in  place  of  smoothing  to  test  the  contribu- 
tion of  the  latter.   Thus,  for  Method  C  we  estimate   a   by 


/1E°    A   l 

2     t  ,  L. 


•■■c-'t  't^-4 

Accordingly,  the  estimated  reorder  level  becomes 

(5)  R  =  y  +  Kac. 

In  our  fourth  method  we  test  the  contribution  of  both 
smoothing  and  MAD  by  dropping  them  altogether,  estimating   a   by 
maximum  likelihood  but  continuing  to  smooth  the  data  to  estimate 
y .   In  Method  D  then , 


a^  =  /  —  Y   (x,  -x)  2   where   x  =  —  T   x. 

D        t  kii    ^  t  j=i    3 


and  the  estimated  reorder  level  becomes, 


(6)  R  =  y  +  KaD- 


Finally,  we  label  our  norm,  wherein  both   y   and   a   are 
estimated  by  maximum  likelihood,  as  Method  E.   In  that  case,  the 
estimated  reorder  level  is  maximum  likelihood  as  previously 
pointed  out.   That  is, 

(7)  R  =  X  +  KaQ. 

There  are  a  variety  of  ways  that  these  five  methods  might 
be  compared  and  we  examined  several.   For  present  reporting  pur- 
poses, however,  we  were  content  to  examine  the  effects  on  reorder 
levels.   For  simulation  purposes,  the  following  general  considera- 
tions apply.   (More  particulars  may  be  found  in  the  program  summary 
in  Appendix  A.)   First,  our  main  concern  here  is  with  statistical 
characteristics.   In  the  absence  of  analytical  results  we  must 
have  a  large  sample  size   (t)   and   t  =  100   seemed  comfortable. 
Again,  we  emphasize  that  our  present  concern  is  not  with  the  real 
application  where  a  history  of  100  periods  might  be  totally 
unreasonable.   Secondly,  since  we  are  simulating,  we  need  to  repli- 
cate the  system  a  large  number  of  times  and  we  chose   NR  =  100 
for  the  number  of  replications  in  each  case.   Finally,  it  is 
necessary  to  restrict  ourselves  to  a  selective  choice  of  parameters, 
notably  the  smoothing  constant  a,   the  mean   y   and  the  standard 
deviation   a   of  the  underlying  demand,  the  risk  level   p   and, 
as  a  consequence,  what  we  will  refer  to  as  the  theoretical  reorder 
level   R  =  y  +  Ka .   The  basic  parameter  choices  were  made  as  a 
result  of  examining  our  previous  reports  for  those  choices  where 
differences  were  particularly  marked. 
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For  each  choice  of   u,   a,   p   and   R,   the  scenario  was 
duplicated  for   a  =  .1   and   a  =  .2   which  are  two  choices 
presently  in  vogue  in  applications.   The  basic  results  are  sum- 
marized in  Tables  2.1,  2.2  and  2.3.   In  these  tables,  we  have 
published,  for  each  choice  of  parameters  under  each  of  methods 
A,  B,  C,  D  and  E  the  following  characteristics: 

1.  Average  reorder  level,  being  the  average  over  100  replica- 
tions  of  the  reorder  level  set  at  the  end  of  the  100 —  period  of 
demand. 

2.  The  standard  deviation  of  the  100  reorder  levels  (replica- 
tions) set  at  the  end  of  period  100. 

3.  Using  three  sigma  limits  as  a  guide,  Oversupply  is  defined 
as  the  number  of  units  over  the  reorder  level   R   that  might  be 
encountered. 

4.  Again,  using  three  sigma  as  a  range,  Max  Risk  is  recorded 
as  the  actual  value  of   p   that  might  be  encountered. 

Items  3  and  4,  as  recorded  in  the  tables,  need  additional 
discussion.   Imagine  the  100  replications  as  100  supply  managers, 
each  managing  the  same  item  for  100  periods.   The  first  case 
listed  in  Table  2.1  will  do  for  an  illustration.   The  theoretical 
reorder  level  is  116.45  to  satisfy  a  stockout  risk  of  5%.   In 
Item  1  in  the  table  is  recorded,  for  each  method  being  considered, 
the  average  of  the  100  reorder  levels  that  each  of  the  supply 
managers  would  record  after  100  periods  of  operation.   Immediately 
under  that  in  Item  2  is  listed  the  corresponding  standard  devia- 
tion of  those  reorder  levels.   It  is  easily  observed  that  on  the 
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REORDER  LEVEL 


1 .   Avej 

rage 

PARAMETERS 

2 .  Standard  Dev 

3.  Oversupply 

iation 

4 .   Max 

Risk 

a 

y 

a    p 

R 

A 

B 

C 

D 

E 

116.68 

116.32 

116.55 

116.50 

116.55 

3.51 

3.42 

2.37 

2.37 

1.47 

.1, 

100, 

10,  .05, 

116.45 

10.76 

10.13 

7.21 

7.16 

4.51 

.27 

.27 

.17 

.17 

.11 

116.78 

116.22 

116.57 

116.53 

116.55 

5.40 

5.07 

3.48 

3.47 

1.47 

.2, 

100, 

10,  .05, 

116.45 

16.53 

14.98 

10.56 

10.51 

4.51 

.48 

.46 

.27 

.27 

.11 

26.68 

26.33 

26.55 

26.49 

26.53 

3.49 

3.39 

2.34 

2.34 

1.41 

.1, 

10, 

10,  .05, 

26.45 

10.70 

10.05 

7.12 

7.06 

4.31 

.27 

.27 

.17 

.17 

.11 

26.78 

26.22 

26.57 

26.51 

26.53 

5.39 

5.05 

3.46 

3.45 

1.41 

.2, 

10, 

10,  .05, 

26.45 

16.50 

14.92 

10.50 

10.41 

4.31 

.48 

.46 

.27 

.27 

.11 

141.69 

140.81 

141.38 

141.22 

141.34 

8.73 

8.48 

5.87 

5.86 

3.54 

.1, 

100, 

25,  .05, 

141.125 

26.76 

25.12 

17.87 

17.68 

10.84 

.27 

.27 

.17 

.17 

.11 

141.96 

140.56 

141.43 

141.28 

141.34 

13.47 

12.62 

8.65 

8.62 

3.54 

.2, 

100, 

25,  .05, 

141.125 

41.24 

37.30 

26.26 

26.02 

10.84 

.48 

.46 

.27 

.27 

.11 

Table  2.1 


Effects  on  Reorder  Levels 
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REORDER  LEVEL 


1.   Ave. 

rage 

PARAMETERS 

2.  Sta] 

3.  Ove: 

idard  Deviation 
rsupply 

4 .   Max 

Risk 

a 

V 

a    p 

R 

A 

B 

C 

D 

E 

66.68 

66.32 

66.55 

66.49 

66.54 

3.50 

3.40 

2.36 

2.35 

1.44 

.1, 

50, 

10,  .05, 

66.45 

10.73 

10.07 

7.18 

7.09 

4.41 

.27 

.27 

.17 

.17 

.11 

66.78 

66.22 

66.57 

66.51 

66.  54 

5.40 

5.06 

3.47 

3.46 

1.44 

.2, 

50, 

10,  .05, 

66.45 

16.53 

14.95 

10.53 

10.44 

4.41 

.48 

.46 

.27 

.27 

.11 

112.89 

112.75 

112.96 

112.94 

112.76 

3.26 

3.13 

2.46 

2.48 

1.46 

-li 

100, 

10,  .10, 

112.82 

9.85 

9.32 

7.52 

7.56 

4.32 

.38 

.37 

.29 

.29 

.20 

112.71 

112.46 

112.92 

112.90 

112.76 

4.85 

4.65 

3.45 

3.45 

1.46 

.2, 

100, 

10,  .10, 

112.82 

14.44 

13.59 

10.45 

10.43 

4.32 

.57 

.56 

.40 

.40 

.20 

108.55 

108.45 

108.60 

108.58 

108.40 

2.78 

2.69 

2.35 

2.38 

1.29 

.1, 

100, 

10,  .20, 

108.42 

8.47 

8.10 

7.23 

7.30 

3.85 

.49 

.48 

.44 

.44 

.33 

108.42 

108.25 

108.56 

108.55 

108.40 

4.09 

3.98 

3.37 

3.38 

1.29 

.2, 

100, 

10,  .20, 

108.42 

12.27 

11.77 

10.25 

10.27 

3.85 

.65 

.64 

.56 

.56 

.33 

Table  2.2.   Continuation  of  Table  2.1 
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REORDER  LEVEL 


PARAMETERS 

1.  Average 

2.  Standard  Deviation 

3.  Oversupply 

4.  Max  Risk 

a 

yap 

R 

A 

B 

C 

D 

E 

106.89 

106.82 

106.93 

106.92 

106.74 

2.62 

2.57 

2.35 

2.34 

1.23 

.1, 

100,  10,  .25, 

106.74 

8.01 

7.79 

7.24 

7.20 

3.69 

.54 

.54 

.50 

.50 

.38 

106.78 

106.65 

106.89 

106.89 

106.74 

3.85 

3.77 

3.35 

3.35 

1.23 

.2, 

100,  10,  .25, 

106.74 

11.59 

11.22 

10.20 

10.20 

3.69 

.68 

.68 

.63 

.63 

.38 

11.61 

11.57 

11.60 

11.58 

11.58 

.44 

.41 

.37 

.37 

.35 

.1, 

10,   1,  .05, 

11.645 

1.28 

1.16 

1.06 

1.04 

.98 

.39 

.37 

.31 

.32 

.30 

11.59 

11.54 

11.60 

11.57 

11.58 

.59 

.55 

.44 

.44 

.35 

.2, 

10,   1,  .05, 

11.645 

1.72 

1.54 

1.28 

1.24 

.98 

.57 

.54 

.39 

.40 

.30 

Table  2.3.   Continuation  of  Table  2.2. 
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average  all  methods  do  well  in  yielding  a  reorder  level  near  the 
theoretical  one.   But  that  is  an  average  reorder  level.   For  each 
method  we  might  ask  just  how  widespread  were  the  actual  reorder 
levels  that  went  in  to  make  up  the  average?   Well,  there  are  two 
ways  here  to  measure  "bad."   At  one  extreme,  using  three  sigma 
as  a  guide,  it  is  plausible  that  some  of  the  100  supply  managers 
experienced  reorder  levels  as  high  as  the  average  plus  three  sigma 
and  others  as  low  as  the  average  minus  three  sigma.   For  example, 
under  Method  A  at  least  one  of  the  supply  managers  might  have 
recorded  a  reorder  level  of  127.21,  thus  carrying  10.76  items 
more  than  he  would  have  had  he  known  the  parameters   u   and   a. 
By  the  same  token,  at  least  one  other  manager  might  have  estimated 
R   to  be  as  low  as  106.15  in  which  case  the  actual  stockout  risk 
he  faces  would  be  27%,  not  5%.   This  has  been  recorded,  for  lack 
of  a  better  name,  as  Max  Risk  in  Item  4  of  each  table. 

Now  looking  at  the  three  tables  as  a  whole,  some  definite 
conclusions  may  be  drawn.   The  actual  numbers  recorded  as  Over- 
supply  and  Max  Risk  may  or  may  not  be  significant.   These  consid- 
erations would  depend  on  the  unit  cost  on  the  one  hand,  and  on 
the  penalty  cost  for  being  out  of  stock  on  the  other  hand.   Natur- 
ally, these  will  vary  from  one  item  to  another  and  no  attempt 
will  be  made  here  to  qualify  those  entries  further.   What  is  of 
concern  here  is  the  unmistakable  trend  toward  improvement — either 
way — as  we  proceed  from  Method  A  to  Method  E,  that  is  from  smooth- 
ing with  MAD  to  complete  maximum  likelihood.   Except  for  Methods  C 
and  D,  which  are  always  quite  close  in  value  and  occasionally 
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reverse  the  order,  the  improvement  trend  is  overwhelmingly  in  the 
stated  order.  While  this  does  not  constitute  analytical  proof  by 
any  means,  it  certainly  lends  a  great  deal  of  support  to  the  con- 
jecture that,  under  the  assumptions  stated,  exponential  smoothing 
produces  greater  variability  than  maximum  likelihood. 

But  much  more  can  be  gleaned  out  of  the  results!   We  set 
out  to  test  variations  of  smoothing  and  the  results  are  ordered 
in  a  natural  sequence.   Starting  with  smoothed  estimates  of   y 
and   a   via  MAD,  some  improvement  in  both  Max  Risk  and  Oversupply 
(however  slight)  is  achieved  simply  by  smoothing  squared  forecast 
error  rather  than  absolute  forecast  error.   That  is  Method  B.   But 
the  improvement  is  slight  in  most  cases  which  supports  the  con- 
jecture that  MAD  per  se  is  not  the  largest  contributor  to  varia- 
bility. 

Method  C  begins  to  test  the  contribution  of  smoothing  since 
it  differs  from  Method  B  only  in  averaging  squared  forecast  error 
in  the  traditional  sense  rather  than  a  smoothed  average.   In  most 
cases,  a  reasonable  amount  of  improvement  results.   We  have  already 
remarked  that  Method  D  produces  results  quite  similar  and  occasion- 
ally just  slightly  better  than  Method  C.   Since  the  only  difference 
is  averaging  squared  deviations  from  the  mean  rather  than  squared 
forecast  errors,  one  may  guess  that  the  introduction  of  the  latter 
is  not  too  significant  in  contributing  to  variability. 

Finally,  in  Method  E,   y   itself  is  estimated  by  maximum 
likelihood  along  with   a   and  the  results  speak  for  themselves 
and  confirm  once  again  what  has  been  repeatedly  observed  in  previous 
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reports.   No  need  to  belabor  that  point  here  but  we  may  say  in 
conclusion  that  it  appears  to  be  the  method  of  exponential  smooth- 
ing that  is  the  real  villain  in  inflating  the  variability  of  the 
reorder  level — and  that  is  true  after  100  periods  of  operation  it 
should  be  pointed  out  I   Additionally,  we  can  see  from  the  tables 
that  the  choice  of   a  =  .2   uniformly  produces  worse  results  than 
the  choice   a  =  .1,  and  that  improvement  is  directly  proportional 
to   a.   The  unmistakable  guideline  resulting  from  all  this  seems 
to  be:   If  there  is  any  reason  to  believe  that  demand  is  normal 
with  constant  parameters  over  time,  do  not  smooth,  and  if  you  do, 
choose  a  small  value  of   a.   In  any  case,  be  aware  of  the  fact 
that  the  smoothing  operator  appears  to  produce  more  variability, 
hence  more  unnecessary  cause  for  alarm  (unreliable  reorder  levels) , 
than  more  traditional  methods  of  averaging. 
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3.   Variable  Mean  Demand 

It  was,  of  course,  predictable  that  smoothing  would  fare 
worse  than  maximum  likelihood  in  a  constant  mean  model.   The  only 
question  is  just  how  inferior  in  such  a  case.   As  suggested  in 
earlier  reports,  [3]  in  particular,  smoothing  is  essentially  an 
adaptive  scheme  and  would  appear  to  be  more  suitable  for  a  situa- 
tion in  which  the  mean  value  varies  over  time.   One  note  of  caution 
should  be  added,  however.   The  fact  that  the  actual  demand  itself 
varies  from  period  to  period  does  not  itself  indicate  a  changing 
mean  value.   Indeed,  it  is  in  the  random  nature  of  affairs  that, 
particularly  with  large  variances,  an  actual  demand  record  may 
appear  to  vary  a  good  deal  from  period  to  period  when  in  fact  the 
mean  is  constant.   Whether  or  not  the  mean  is  constant,  then,  is 
a  question  of  the  model. 

But  it  is  easy  to  imagine  conditions  for  which  a  constant 
mean  model  is  inappropriate.   For  example  in  a  military  supply 
system  it  is  clear  that  the  mean  demand  for  certain  kinds  of  parts 
should  shift  to  a  higher,  even  if  constant,  level  during  a  sudden 
global  crisis.   Or,  it  might  be  that  even  though  mean  demand  is 
constant,  record  keeping  and  reporting  is  of  such  a  nature  that 
demand  records  do  not  reflect  such  an  assumption.   The  fact  that 
a  constant  mean  is  inherent  in  the  process  is  really  of  minor 
concern  then  to  the  decision  maker  who  must  base  his  actions  on 
what  he  actually  observes.   More  about  this  point  in  the  next  sec- 
tion where  real  demand  data  have  been  examined. 
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For  these  reasons  we  decided  to  compare  exponential 
smoothing  to  other  alternate  forecasting  schemes  including  maxi- 
mum likelihood  under  various  mean  value  functions,  a  program 
suggested  in  [3]  as  a  continuation  of  that  study.   But,  how  shall 
the  mean  value  be  allowed  to  vary?   Without  some  regularity,  it 
is  almost  certain  that  no  general  statements  would  be  forthcoming. 
Moreover,  recognizing  the  lack  of  analytical  results  for  smoothing 
even  in  the  constant  mean  model,  simulation  would  almost  surely 
have  to  be  used  as  a  method  of  generating  statistical  properties. 

With  regard  to  the  mean  value  function,  the  authors  are 
aware  of  no  study  within  NAVSUP  to  indicate  just  what  assumptions 
would  be  realistic.   Lacking  that,  five  different  patterns  were 
selected  as  plausible  assumptions  for  various  situations  reason- 
ably faced  by  military  supply  systems  and,  for  purposes  of  gener- 
ating data  and  controlling  the  parameters,  normal  demand  is 
universally  assumed.   Throughout  this  section,  the  five  demand 
patterns  are  identified  as  follows: 

Pattern  1:   Mean  demand  is  allowed  to  increase  by  5  0%  in 
Period  3  and  remain  at  that  level  thereafter. 

Pattern  2:   Same  as  Pattern  1  except  the  increase  in  Period  3 
is  100%. 

Pattern  3:   An  impulse  pattern  wherein  mean  demand  is  allowed 

to  increase  in  Period  3  by  100%  and  then  immediately 
decreases  to  its  previous  level  where  it  remains. 

Pattern  4:   A  ramp  in  which  the  mean  value  increases  by  10% 
in  each  period  starting  with  Period  3. 

Pattern  5:   Same  as  Pattern  4  except  that  the  mean  value 

becomes  and  remains  constant  at  its  value  in  Period  4. 
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As  to  the  various  forecasting  schemes  to  be  compared, 
originally  the  Bayesian  method  recommended  in  [3]  was  considered 
along  with  exponential  smoothing,  maximum  likelihood  and  a  moving 


average.   Specifically,  when  demand  is  normal,   N(y,a  ),   with 

9  t  . 

a    known,   and  when  the  prior  on   y   is  taken  to  be  also  normal, 

N(uq,Qq) ,   with   uQ   and   a2   specified,  there  is  a  natural  way 

to  generate  a  posterior  normal  distribution  at  the  end  of  each 

period  using  the  posterior  of  the  last  period  as  the  prior  for 

the  current  one.   In  this  way,  one  obtains  a  Bayes  estimate,   y  , 

of   y   (the  mean  of  the  posterior  in  each  period)  as  a  forecast 

of  demand  for  the  next  period.   Reorder  levels  may  then  be  set 

at   y   +  Ka.     As  previously  reported  then,  the  ratio  o*/o2 

plays  roughly  the  same  role  as  a  smoothing  constant  and  in  any 

case  must  be  specified.   But  in  simulation,   a2   is  deliberately 

selected  and  known,  so  that   a2,   can  then  be  selected  to  reflect 

the  relative  degree  of  imperfect  information. 

Four  different  Bayes  cases  were  tested  and  were  found  to 

either  be  very  inferior  to  the  other  schemes  or  at  best  equivalent 

to  maximum  likelihood  (at  least  asymptotically) .   Consequently, 

the  Bayes  procedures  were  abandoned  in  the  early  stages  of  this 

investigation  and  those  results  are  not  reported  here.   This  is 

not  to  say,  however,  that  Bayesian  methods  should  be  ignored  in 

studying  a  variable  mean.   They  are,  after  all,  adaptive  schemes 


When  both   y   and   a    are  assumed  unknown,  not  a  lot  is  available 
in  the  way  of  prior  assumptions  that  lead  to  tractable  results. 

ft 

A  modification  over  what  appears  in  [3]. 

21 


and,  broadly  speaking  are  quite  amenable  to  precisely  those 
situations.   The  particular  scheme  examined  here  is  a  very  special 
one  and  may  not  be  indicative  of  the  potential  of  the  class  as  a 
whole. 

Very  much  related  to  the  abandonment  of  the  Bayes  schemes 
is  the  question  of  criteria  for  comparison.   Naturally  there  are 
many  ways  in  which  forecasting  methods  might  be  judged.   Clearly 
the  ranking  by  one  method  might  very  well  change  if  a  different 
criterion  were  to  be  adopted.   With  no  specific  guidelines  to 
dictate  a  choice,  mean  squared  forecast  error  was  finally  selected 
as  the  criterion  for  comparison  for  several  reasons.   First,  it 
has  a  certain  amount  of  universal  appeal  as  a  measure  of  "closeness." 
And  that  after  all,  is  our  main  concern  in  examining  the  inherent 
characteristics  of  each  scheme  as  regards  its  forecasting  ability. 
Secondly,  mean  squared  error  is  functionally  related  to  variance 
and,  with  all  schemes  judged  (perhaps  prematurely)  to  be  accurate 
with  respect  to  average,  the  results  would  also  be  a  rough  indica- 
tor of  variability,  which  has  been  one  of  our  main  concerns  in 
this  and  related  studies. 

Finally,  with  regard  to  the  total  number  of  demand  periods, 
we  first  felt  constrained  by  the  fact  that  only  eight  quarters  of 
real  data  are  presently  maintained  in  the  files  by  NAVSUP.   On  the 
other  hand,  this  places  severe  limitations  on  maximum  likelihood 
and  moving  averages  especially.   Hence,  we  decided  to  examine 
the  status  of  forecast  errors  at  the  end  of  eight  quarters  and 
again  at  the  end  of  twenty  quarters.   This  allowed  us  to  examine, 
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to  some  extent  short  of  asymptotic  conditions,  the  effect  time 
might  have  on  the  results  with  obvious  implications  then  for  more 
data  storage.   Other  time  periods  were  examined  but  are  not 
reported  here. 

Initially,  the  number  of  replications  in  the  simulation 
was  allowed  to  vary  over  several  values  but,  with  an  exception  or 
two,  the  results  reported  here  are  based  on  100  replications.   We 
saw  no  significant  changes  when  that  figure  was  allowed  to  increase. 
In  any  case,  an  outline  of  the  program  used  is  included  in  Appendix 
B  so  that  the  interested  reader  may  generate  his  own  data  to 
validate  these,  as  well  as  any  other,  observations  recorded  here. 

One  disadvantage  in  adopting  mean  squared  error  as  a  cri- 
terion is  the  difficulty  of  interpreting  the  results  as  meaningful 
units  of  measurement  error.   This  is  especially  true  when  it  comes 
to  comparing  two  or  more  methods.   What  does  it  mean  to  say,  for 
example,  that  the  mean  squared  forecast  error  of  Method  A  after 
eight  periods  was  274.98  while  that  for  Method  B  was  224.47?   We 
can  certainly  say  that  Method  B  was  better  than  Method  A,  but  it 
would  be  very  difficult  to  say  how  much  better.   And  yet,  for 
reasons  already  mentioned,  we  prefer  to  use  this  abstract  criterion. 
Consequently,  we  have  summarized  our  results  in  terms  of  relative 
ranking,  ever  on  the  lookout  for  emerging  rank  patterns.   These 
results  are  summarized  in  Tables  3.1  and  3.2.   Some  explanatory 
remarks  and  summary  highlights  are  in  order. 

Each  set  of  rankings  accompanies  a  choice  of  parameter 
quadruples   (y,a,N,NR)   in  which   y   and  a      are  the  mean  and 
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standard  deviation  of  normal  demand,   N   is  the  number  of  periods 
for  which  demand  is  generated  and  forecast,  and   NR   is  the  number 
of  replications  for  simulation  purposes.   As  demand  is  then  gen- 
erated under  each  of  the  demand  patterns  previously  discussed, 
four  different  methods  of  forecasting  are  used  to  forecast  demand. 
These  are  designated   S,   for  exponential  smoothing  with  smoothing 
constant   a  =  0.1   and   S~   for  exponential  smoothing  with   a  =  0.2; 
ML   stands  for  maximum  likelihood  and  MA   for  a  moving  average 
based  on  the  most  recent  eight  periods  of  demand.   The  exact  for- 
mulas used,  along  with  the  initial  conditions  assumed  for  each 
method,  are  listed  in  Appendix  B  with  the  program  summaries. 

Under  the  foregoing  conditions  then,  demand  is  generated 
and  forecast  with  the  resultant  cumulative  forecast  error  recorded 
after   N   periods  and  averaged  by  dividing  by  N.   The  experiment 
is  then  replicated   NR   times  and  the  resulting  mean  (NR)  squared 
forecast  error  (MSFE)  computed  for  each  method  under  each  demand 
pattern.   For  each  demand  pattern,  the  forecast  schemes  are  ranked 
and  recorded  in  the  tables  with  the  first  one  listed  corresponding 
to  the  smallest  mean  squared  forecast  error.   Occasionally,  two 
such  values  are  so  close  as  to  be  (subjectively)  considered  as 
ties.   In  that  case,  no  choice  is  made  in  the  rankings.   For  example, 
for  the  parameter  choice  (10,1,20,100)  under  Demand  Pattern  4,  the 
respective  mean  squared  forecast  errors  for   S, ,  S~,      ML   and 
MA  are  35.38,  15.99,  71.95  and  15.84.   It  is  thus  relatively 
impossible  to  distinguish  between   S~   and  MA   so  that  the  ranking 
is  listed  as   MA  or   S~,   S, ,   ML.   Finally,  a  method  has  been 
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underlined  now  and  then  in  the  ranking  list  to  indicate  that  its 
MSFE  is  of  an  order  of  magnitude  greater  than  the  rest,  thereby 
singling  it  out  as  a  particularly  poor  choice. 

As  it  turned  out,  the  ranking  patterns  began  to  emerge 
according  to  variance-to-mean  ratios  and,  accordingly,  the  summary 
tables  are  arranged  so  as  to  identify  groups  by  values  of  o2/\i. 
Predictably,  results  are  much  more  consistent  and  stable  for  small 
values  of  o2/\x      in  contrast  to  large  values.   In  particular,  for 
o2/\i   ^  1,   it  is  almost  always  the  case  that  the  preference,  in 
order  of  most  preferred  first,  occurs  as   S2,   MA,   S, ,   ML   for 
all  demand  patterns  save  one.   For  Pattern  3,  the  ordering  is   ML, 
S, ,   S~,   MA  and  this  seems  to  be  the  one  constant  element  in  all 
cases.   That  is,  for  Pattern  3,  maximum  likelihood  is  preferred 
(if  however  slightly)  to  both  forms  of  smoothing  and  the  moving 
average  is  the  worst  choice. 

When  o2/\i    >   1,   results  are  not  so  clear  cut  except  as 
just  mentioned  for  Pattern  3.   For  Pattern  4,  the  preference  order- 
ing is  basically   S2,   MA,   S,,   ML;   for  Pattern  5,  it  is  basic- 
ally ML,   S, ,   S2,   MA   as  for  Pattern  3.   About  all  that  can  be 
said  about  Pattern  1  when  o2 /\i    >  1,   is  that  MA   seems  never  to 
be  preferred;  otherwise,  each  of  the  other  techniques  occurs  at 
least  once  on  the  preferred  list. 

Finally,  it  might  be  remarked,  as  anticipated,  that  the 
standard  deviations  occur  in  roughly  the  same  order  as  the  MSFE 
ranks.   This  does  not  show  up  in  the  summary  tables,  however.   It 
might  also  be  observed  that,  basically,  the  increase  in  periods 
observed  from  N=8   to   N=20   contributes  little  to  the  ordering 
scheme . 
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4.   Sample  Characteristics  of  Real  Data 

The  results  of  the  previous  section  depend  very  much  on 
the  assumption  that  demand  is  normally  distributed  with  a  mean 
value  that  varies  according  to  specific  types  of  functions.   At 
that,  only  five  such  functions  were  tested.   And  in  each  of  those 
patterns  the  variance  was  held  constant.   Naturally,  the  applica- 
tion of  such  results  to  real  data  is  severely  restrictive,  particu- 
larly in  view  of  the  fact  that  little  documentation  presently  exists 
regarding  the  true  nature  of  demand  for  many  kinds  of  items  managed 
by  NAVSUP.   We  therefore  set  about  to  run  similar  comparisons  on 
real  data.   Even  though  the  underlying  model  for  the  data  is 
unknown,  one  can  still  ask  in  retrospect,  given  the  data,  what 
would  have  happened  had  a  different  forecasting  scheme  been  used? 

The  data  used  to  address  this  question  were  supplied  from 
the  files  of  the  Ships  Parts  Control  Center  (SPCC) ,  Mechanicsburg , 
Pennsylvania,  with  the  cooperation  and  assistance  of  Mssrs.  R. 
Brumbaugh  and  J.  Zerbe  of  the  Fleet  Material  Support  Office  (FMSO) . 
Unfortunately,  demand  history  is  retained  only  for  the  current 
and  seven  previous  quarters  for  a  total  of   N  =  8   quarters  or 
periods.   To  help  counterbalance  this  very  small  value,  a  relatively 
large  sample  of  10,000  items  was  taken.   The  sample  included  only 
secondary,  non-reparable  items  and  only  recurring  maintenance 
demand  was  considered.   So-called  insurance  items  (those  for  which 
demand  is  less  than  one  per  year)  were  excluded  because  they  obviously 
generate  special  forecasting  problems  of  their  own,  particularly 
in  view  of  the  short  history  of  eight  quarters.   Even  with  these 
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items  excluded,  however,  859  of  the  10,000  experienced  no  demand 
during  the  two-year  period  examined  (1973-74) . 

A  histogram  displaying  the  frequency  distribution  of  the 
data  is  displayed  in  Figure  4.1.   The  frequencies  are  graphed  as 
proportions  (out  of  10,000)  according  to  the  average  of  the  eight 
observations.   The  observed  number  (in  each  interval  [a,b))  is 
listed  at  the  end  of  each  bar  for  further  identification.   From 
these  data,  it  was  determined  that  the  ensemble  mean  is  13.545 
while  the  median  is  only  1.5.   As  a  matter  of  additional  interest, 
the  90 —  percentile  turned  out  to  be  14.375.   Incidentally,  if 
from  the  10,000  items,  the  859  having  zero  records  were  eliminated, 
the  sample  mean  would  only  be  increased  to  14.818. 

The  fact  that  only  eight  quarters  of  demand  are  available 
poses  several  problems.   All  of  our  forecasting  techniques  require 
some  initial  assumptions  at  the  beginning  of  the  recorded  demand 
period.   For  the  two  smoothing  techniques  (S,  and  S~)  that  amounts 
to  an  initial  forecast.   For  the  moving  average  (MA)  technique, 
each  of  the  preceding  eight  quarters  would  be  needed,  strictly 
speaking,  to  implement  the  technique.   In  the  absence  of  such 
information,  the  assumption  made  here  is  that  each  of  these  is 
equal  to  some  initial  forecast.   Maximum  likelihood  requires  the 
entire  past  history  so,  to  put  things  on  an  equitable  footing,  we 
assume  that  eight  previous  quarters  is  the  entire  past  and  that 
each  observation  in  those  quarters  is  equal  to  an  initial  forecast. 

This  forces  the  beginning  stage  of  each  of  our  four  fore- 
casting techniques  to  depend  on  an  initial  forecast.   It  was  felt 
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that  any  systematic  calculation  of  an  initial  forecast  from  the  data 
might  introduce  extraneous  bias  in  favor  of  one  or  the  other  of 
the  techniques.   It  was  therefore  decided  to  use  the  ad  hoc 
procedure  of  taking  the  midpoint  of  the  range  of  observations 
being  considered.   Thus,  for  example,  for  all  items  whose  average 
falls  between  4.0  and  6.0  inclusive,  an  initial  forecast  of  5.0 
was  used;  for  items  whose  averages  are  between  2.0  and  3.0,  an 
initial  forecast  of  2.5  was  used,  and  so  on. 

One  rather  unexpected  phenomenon  observed  in  the  sample 
data  was  the  tendency  for  demands  to  be  clumped  together,  rather 
than  more  evenly  distributed  throughout  the  eight  observed  quarters. 
A  list  of  just  a  few  such  items  is  displayed  in  Figure  4.2.   Such 
records,  where  an  observed  demand  is  much  larger  than  expected 
and  occuring  rarely  at  that,  make  any  kind  of  uniform  assumption 
from  quarter  to  quarter  untenable.   Certainly  it  makes  the  constant 
mean  model,  discussed  in  Section  2,  extremely  suspect. 


QUARTER 

Item 
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6 

7 

8 

A 

44 

0 

0 

0 

2 

1 
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0 
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10 

2 

0 

0 

3 

1 

20 

3 

C 

0 

0 

0 

0 

0 

12 

25 

0 

D 

0 

16 

10 

15 

0 

0 

0 

20 

E 

0 

0 

10 

0 

10 

20 

0 

0 

Figure  4.2.   Distribution  by  Quarters. 
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There  are  many  possible  explanations  for  this  phenomenon.   One 
possibility  is  that  many  of  these  demands  are  for  storeroom  stock 
at  an  end-use  activity,  or  at  some  intermediate  echelon.   The  actual 
use  of  the  material  may  indeed  be  at  a  relatively  uniform  rate 
but  the  item  is  ordered  in  batches  at  these  other  levels.    Or 
it  may  be  that  the  demands  themselves  satisfy  the  uniform  (identi- 
cally distributed)  assumption  well  enough  but  the  record  keeping 
is  of  such  a  nature  that  they  appear  in  this  form.   Nevertheless, 
a  model  for  such  records,  if  that  is  in  fact  what  decisions  will 
be  based  on,  will  have  to  take  that  into  account. 

In  order  to  compare  the  four  forecasting  methods  under 
consideration,  again  the  question  of  criteria  or  measures  of 
effectiveness  arises.   For  reasons  previously  discussed,  mean 
squared  forecast  error  was  adopted.   Using  four  different  group- 
ings by  a  range  of  sample  means,  the  average   (N =  8)   forecast 
error  for  each  of  the  four  forecasting  methods  utilized  in  Section 
3  was  computed.   The  number  of  items  in  each  group  then  corresponds 
to   NR   in  the  simulations  and  permits  the  computation  of  an  over- 
all mean  squared  forecast  error  (MSFE) .   (Thus,  the  ad  hoc  group- 
ing was  done  to  give  a  respectable  value  of   NR   for  the  group. ) 
This  then  allows  us  to  order  the  forecast  methods  in  order  of 
preference  as  in  Section  3.   As  a  matter  of  added  interest,  the 
standard  deviation  (SD)  and  the   90 —  percentile   Pg0   are 
reported  along  with  the  mean  squared  forecast  error.   These  results 


With  multiple  users,  such  demands  would  tend  to  even  out  but 
most  items  of  that  type  have  been  transferred  to  the  Defense  Supply 
Agency  for  management. 
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are  summarized  in  Figure  4.3  where  a  group  is  defined  by  the 
indicated  interval  of  means  and   NR,   the  total  of  such  observa- 
tions available  is  also  indicated  for  each  group. 

Some  obvious  degrees  of  caution  should  be  exercised  in 
interpreting  the  results  of  the  table.   To  repeat  an  earlier 
point,  only   N=8   observations  were  available  for  computing 
purposes.   This  alone  makes  generalizations  difficult.   With  so 
few  items  available  in  the  mid-range  values  of  means,  observa- 
tions were  grouped  rather  arbitrarily  to  make  the  value  of   NR 
reasonable.   At  that,  only  about  2500  of  the  10,000  items  were 
finally  included  in  the  comparisons.   Finally,  the  initial  assump- 
tions were  selected  on  simply  a  rational  basis  and  certainly 
affect  the  results. 

With  those  cautions  in  mind,  however,  it  may  be  noted  that 
the  results  are  fairly  consistent  with  the  simulation  results  of 
the  previous  section  particularly  when  compared  to  Demand  Pattern 
3  of  that  section.   This  should  not  be  too  surprising  since  the 
batching  we  mentioned  earlier  has  roughly  the  same  effect  as 
Demand  Pattern  3.   In  particular,  for  these  items,   ML  and   S, 
are  always  preferred  to   MA   and   S~   with  MA   consistently  out- 
performing  S2,   however  slightly.   We  can  say,  however,  that  on 
the  average   ML  would  have  been  as  good  or  better  than   S,   had 
that  method  been  used  with  the  same  data.   But,  considering  the 
prior  assumptions  made  for  this  study,  that  preference  is  certainly 
not  a  strong  one. 
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Forecast 

Method 

Group 

Characteristics 

Sl 

S2 

MA 

ML 

I 

MSFE 

15.69 

16.78 

16.54 

15.65 

[2.0,3.0] 

SD 

13.77 

14.86 

14.43 

13.67 

NR=  999 

p 
90 

39.02 

41.90 

40.56 

38.25 

II 

MSFE 

51.57 

55.11 

54.40 

51.42 

[4.0,6.0] 

SD 

48.17 

51.82 

50.67 

47.99 

NR=  695 

p 
90 

111.55 

119.31 

117.40 

111.26 

III 

MSFE 

106.44 

113.81 

112.43 

106.58 

[6.0,8.0] 

SD 

92.01 

99.22 

96.71 

92.36 

NR=  488 

p 
90 

286.97 

308.69 

299.04 

286.43 

IV 

MSFE 

160.44 

171.21 

169.75 

160.17 

[8.0,10.0] 

SD 

146.68 

158.17 

153.86 

145.98 

NR  =  300 

p 
90 

346.86 

376.57 

361.13 

346.65 

Figure  4.3.   Characteristics  of  Forecast  Methods. 
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We  should  also  remark  that  these  results  have  been  carried 

out  as  an  academic  study  without  regard  to  modifications  in  the 

real  applications.   But  as  a  matter  of  fact,  SPCC  often  employs 

a  "trending"  technique  which  is  intended  to  detect  any  significant 

trend  (up  or  down)  in  the  mean  of  the  demand  distribution.   The 

technique  is  to  compute  the  value  of 

2(D  +D  ) 
(1)  T  = 


D0  +  Dl  +  D2  +  D3 


where   D.   is  the  demand  observed  in  the   i —  past  quarter.   If 
Te  [0.9,1.1],   a  smoothing  weight  of   a  =  0.1   is  used;  otherwise 
a   is  chosen  to  be   0.3.   Clearly,  when  two  or  more  consecutive 
observations  are  zero,   T  will  fail  to  be  in  the  test  interval. 

As  we  mentioned  earlier,  the  data  we  have  examined  are 
frequently  of  this  very  nature  so  that,  for  these  items,  trending 
can  be  expected  to  occur  quite  often.   But,  assuming  that  the  pat- 
terns shown  in  these  data  tend  to  be  repetitive,  trending  merely 
adds  another  harmful  effect  to  the  forecast.   That  is  to  say,  if 
the  data  tend  to  repeatedly  peak  and  then  settle  back  to  a  lower 
level  (for  whatever  underlying  causes) ,  trending  will  only  add  to 
exponential  smoothing  in  placing  undue  weight  on  the  misleading 
peak  values.   There  are  obvious  implications  here  for  a  better 
understanding  of  the  underlying  model  for  the  data  since  so  many 
items  are  involved. 
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5.   Conclusions  and  Recommendations 

This  is  the  fourth  in  a  series  of  reports  devoted  to  the 
study  of  demand  forecasting  (and  exponential  smoothing  in  particu- 
lar) carried  out  at  the  Naval  Postgraduate  School  under  the  spon- 
sorship of  the  Naval  Supply  Systems  Command.   The  study  is  of 
particular  importance  to  real  applications  since  exponential 

smoothing  has  become  a  basic  forecasting  tool  for  supply  systems. 
When  exponential  smoothing  is  coupled  with  MAD  as  a  method 

of  estimating  variability,  a  great  deal  of  analytical  difficulty 
is  encountered  even  when  the  most  stable  assumptions  are  made  with 
regard  to  the  demand  distribution.   All  of  this  has  been  exten- 
sively documented  in  earlier  reports  and  accounts  for  the  continued 
use  of  simulation  as  an  investigative  tool. 

In  those  earlier  reports,  it  was  demonstrated  that,  at  least 
in  a  constant  mean  model,  smoothing  seems  to  produce  more  variable 
predictions  than  some  other  alternatives.   We  set  about  in  this 
study  to  try  and  isolate  the  source  of  that  variability.   In  Section 
2  we  have  shown  that  exponential  smoothing,  rather  than  the  use  of 
MAD  per  se,  seems  to  be  the  main  contributor.   While  no  one  case 
studied  can  in  itself  be  relied  on  too  heavily  due  to  simulation, 
the  overwhelming  consistency  in  case  after  case  studied  of  improve- 
ment in  variability  from  smoothing  with  MAD,  through  several  inter- 
mediate modifications,  to  pure  maximum  likelihood  leaves  little 
doubt  about  the  conclusion  to  be  drawn. 

But  demands  in  real  life  seldom  have  a  constant  mean  it  is 
argued.   Surely  for  a  varying  mean  value,  an  adaptive  procedure 
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like  exponential  smoothing  must  be  better  to  use  than  one  designed 
for  more  stable  conditions.   We  addressed  this  problem  and  the 
results  in  Section  3  show  that  this  is  sometimes  true  and  some- 
times not.   In  particular,  when  the  mean  value  has  a  sudden  jump 
but  then  settles  back  to  its  previous  level,  maximum  likelihood 
is  still  a  better  procedure  to  use.   When  we  allowed  the  mean  to 
change  in  other  ways  (step  and  ramp)  however,  exponential  smooth- 
ing emerged  as  a  better  candidate  than  either  maximum  likelihood 
or  a  moving  average  for  predicting  such  changes. 

Not  content  to  rely  exclusively  on  simulated  results,  how- 
ever, we  retrieved  real  demand  data  for  additional  study.   Unfor- 
tunately, only  eight  quarters  of  such  demand  were  available  for 
processing  which  makes  generalization  extremely  awkward.   For  this 
reason,  we  have  attempted  to  mollify  our  conclusions  in  Section  4 
to  reflect  the  small  sample  size.   To  our  surprise,  a  large  number 
of  items  revealed  demand  histories  that  were  more  compatible  with 
the  one  model  of  Section  3  for  which  maximum  likelihood  was  a 
leader.   It  is  not  surprising  then,  that  when  the  data  were  judged 
by  the  same  ground  rules,  maximum  likelihood  was  slightly  better. 
But,  with  no  real  model  available,  certainly  any  recommendation 
would  be  indecisive.   The  best  that  can  be  said  is  that,  had 
maximum  likelihood  been  used  on  several  of  those  items  observed 
instead  of  exponential  smoothing,  the  overall  forecast  would  have 
improved,  if  however  slightly,  in  some  cases. 

The  first  recommendation  growing  out  of  this  study  then  is 
that  more  should  be  known  about  the  underlying  model  before  any 
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decisive  conclusions  can  be  drawn.   No  respectable  analysis  can 
be  performed  on  such  limited  histories  but  enough  is  indicated 
here  to  suggest  the  importance  of  getting  closer  to  the  underlying 
model.   The  implication  for  additional  data  storage  is  obvious. 
It  should  also  be  pointed  out  that,  even  apart  from  that,  only 
five  different  demand  patterns  were  studied  here.   Surely  other, 
perhaps  even  more  appropriate,  patterns  might  occur  to  users.   For 
this  reason,  we  have  included  our  programs  in  various  appendices 
for  modification  and  use  by  the  interested  reader. 

In  that  regard,  we  have  added  an  appendix  concerned  with 
computational  speed.   A  case  for  exponential  smoothing  has  been 
consistently  made  in  the  past  (particularly  by  Brown  [4])  on  the 
basis  of  computer  storage  and  speed  in  computation.   But  computer 
technology  has  made  giant  strides  in  recent  years.   In  Appendix  D 
processing  times  for  various  forecasting  techniques  are  compared 
utilizing  1968  state-of-the-art  equipment.   Processing  times  are 
even  faster  now  and  hence  should  no  longer  be  a  significant  factor 
in  the  selection  of  forecasting  techniques,  at  least  of  the  types 
discussed  in  this  report. 
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6 .   Appendices 

APPENDIX  A  -  Comparing  Variability 
This  program  simulates  normally  distributed  demands  with 
constant  mean  and  variance.   As  in  the  following  program  (Appendix  B) 
the  Learmonth-Lewis  random  number  package  LLRANDOM  [6]  was  used. 
All  programs  were  written  in  FORTRAN  IV  and  run  on  the  IBM  36  0/67 
computer  of  the  W.  R.  Church  Computer  Center  at  the  Naval  Post- 
graduate School. 

L   PKi  -  <  '  COMPARES    SCHEMES  FUR  FOREC AS T I NG  STD  DEVIATION  UF  DEMAND 
VPI4)  NUST  BE  .LE.100  UNLESS  DIMENSION  STATEMENT  CHANGED 
RkOGRAM  TFKMINATtb  WHEN  IT  kt:ADS  AN  ALPHA  .GE.  1.0 
C  1-10  =  SHuGTHINu  CONSTANT 

i'iU     C(      11-20  =  MEAN  Of  DEMAND  D I  S  T  R  I  BUT  I  UN  (NORMAL) 
C   SIGMA  CC  21-30  =  S.D.  OF  DEMAND  DISTRIBUTION 
(.   NK     CC  31-35  RIGHT  JUSTIFIED  -  NUMBER  Of  REPLICATIONS 
C   NPUJ  CC  36-40, 41-45, 46-50, 51-55  RIGHT  JUSTIFIED  ARE  PERIUDS  WHERE 
I  SNAPSHOTS  AKh  TAKEN 

1SL-ED  CC  do-oC  FOR  RaNjuM  NR  GENERATOR 
t   RHtJ    CC  bl-Jo       SPECIFY  . 01 , .05. , . 10,.20, . 25 
L   MO  AND  SIGMA  ARE  USED  TO  INiTALIZE  FORECASTS 

M  1  HOD  1:   EXPONENTIALLY  SMOOTHED  MAD  wilTH  HEAD  START 
C     THOD  2:   EXPONENTIALLY  SMOOTHED  MAC  wITH  NO  HEAD  START 
C   METHOD  5   SAMPLE  STANDARD  DEVIATION  WITH  EXP  SMOOTHED  FCST  UF  ML  AN 
C   METHOD  t  cXPGNENT 1  ALLY  SMOOTHED  SQUARED  ERROR  WITH  HEAD  START 

C   METHOD  5    EXPONENTIALLY  SMOOTHED  SQUARED  ERROR  WITH  NO  HEAD  START 
C   METHOD  o    Kl*RMSFE 

C   METHOD  7    MAXIMUM  LIKELIHOOD  FLS1  OF  MEAN  AND  SO 
C 

DIMENSION  X(  100)  ,P(  100)  ,E( 100)  ,SD<7, 100) ,NP{4) ,SM(7,t)  ,oSD<  7,4) 
1  Rl(7,4)  ,R2 (7,4) ,SR<  7,4)  ,SRD( 7,4 ) ,FML ( 100 1 

REAL*4  Kl ,K2,NG,MSPE( 7,4) 

REAL*  3  SSj(7,4),RH7,4),kLSDl7,4)  ,SOn(  7,4) 
I  AL*3  ARG,0R0t RI SK, 5X3,  SSX3 
100  Flk'MAT  (  JL10.4,6  I  5,  LI  0.4) 

1 50    fjhmat    ('oerrgr  =    • ,f10.4) 
Call   ovfluw 

ITYPF     =    4 
10     READ     (5,100)     ALPHA,  MO,  SIGMA,NR,  C  NPt  1  ),  1-1,4)  ,  I  SEED,  PHO 
C         I  ESI     FOR     I c KM i NAT  I  UN 

IE  (  Al.PHA.GE  .  1.0  J     01 J     TO    993 
Kl    =    SQRTI 0.5*12.0    -     ALPHA) ) 
K2     =     1 . 25  3314    *     Kl 
•3ETA     =     1.0    -     ALHHA 
N    =NPI4) 
RK    =     2. 32o 

IF     (PHO     .E»J.     O.Ob)     RK     =     l.o45 
IF     (RHC)     .EQ.     0.10)     RK     =     1.2B2 
'I-      (KHU     .ED.     J. 20)     KK     =     0.842 
If      ( RHO     .  EQ,     0.25  )     RK     =    0  .6 74 
lixL    =     MO     -t-    KK*SiOMA 
^)    ic     I     -    1,7 
DO    I  I      J    -    1  ,4 
SUM      (  I    , J)      =     0. 
.     (  I  ,  J  1     =    0  . 
K 1( I , J )      =     0.0 

R2< I, J)     =    0.0 

RL( I  ,J)     =0.0 

KL  otK  I  ,  J  )     =    0.0 
1  1     CdNJ  INOt 
\d     C      II  INOE 
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C   SUMS.  !NITIAL!ZFD 

Di      50    J    =    1,NR 
C       GENERATE    N(l,l)    VAFIATFS 

CALL    NORMAL      (  I  SE FD , X , N P( 4 )  ) 
rPANSFOPM    T0    N<MU,  SIGMA) 
Df     15    I    =    1,N 
X(  I  )     =    MU    +    SIGMA*X(! ) 
15    CI  NTINUE  £ 

C       COMPUTE    FORECASTS    USING    SINGLE    EXP    SMOOTHING       AND    MAX    LIKALIH00D 

L*  J.        -   m  L  1   L.  XZ. 

f    (  1  )      =     M   j 

Ff-L  (1)     =     Nil 

F( 1)     -     X( I )     -    MU 

CD(1,1)     =    SIGMA 

SX?    =     ABS(F( 1) ) 

SX3    =    X(  1) 

S5X3    =     5X3*5X3 

SX4    =     (SIGMA/K 11**2 

SX6    =     E( 1)*E(1) 

SX5    =     SX6 

c  a  MPUTE    FORECASTS 

c 

Or    2  0    I     =    2,N 

F(I)     =    ALPHA*X(I-1)     +     RETfl*F(I-l) 

E(  I )     =    X(I  )     -    F(  I  ) 
C 
C  METHOD    1 

S0(1,I)    -     BETA*SD(  It  1-1)     ♦    K2*ALPHA*ABS(E<  1-1)  I 
C 
C  MLTHOn    2 

SX2    =    8ETA*SX2    +    ALPHA*A  ,ii,  (  E  (  I  )  > 

50(2, I )     =    K2*SX2 
C 
C  MLTHODS    3    AND    7 

FML( I )     =     (SX3    ♦    MUI/I 

SX3    =    SX3    +    X( I ) 

SSX3    =    SSX3    «■    X( I )*X( I  ) 

c 

16C    FORMAT     ( 1H    , 4( F20. 4, 5X I ) 

ARGU    =     (SSX3    -    SX3*SX3/I)/I 
V/PTTE     (6,160)     X(  I  )  ,SX3,SSX3,ARGU 
SO (3, ! )     =    SQRT    (ARGU) 
IF     (ARGU    .LT.    0. )    STOP 
r 

Sf)(7,  I  )  =  SD(3,I  ) 
C 
C      METHOD  4 

5X4  =  BETA*SX4  +  ALPHA*F ( I -1 ) *E( 1-1 ) 

SD(4, I )  =  K1*SQRT(SX4) 
C 
C      MFTHOD  5 

SX5  =  BETA*SX5  ♦  .UPHA*E(I  )*E(  I  ) 

S)(5,I )  -    K1*SQRT(SX5) 


C 

C      METHOD  6 

5X6  =  5X6  +  E( I)*E(I) 
50(6, I )  =  K1*SQRT(SX6/I) 
20  CONTINUE 
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P.MAT  ( 
P.MAi  ( 
L  8  X ,  •  = 
19X, '= 
'  =  '  .1 
IPMAT     ( 


r>AM 
=  1. 
=     It 

=   su 

SO  (I 

=  s 

=  cl 

_        c 

)     =0 

=    PL 


"LE     STATISTIC, 

4 

7 

M( I , Jl/NP 

,J)     -SUM(! ,J)*SU*( !, J) /NP)/NP 

lJDT(  VftP  ) 

VAR    «■     (SIGMA 
( I , J )/NP 
QRT( (P2(I# J) 
SJPT(  (  RLSDU 
(I, J  )/NR 


-  SM(  !, J)  )**2 

-  Pl( I, J)*P1( I , J)/NR)/NR) 
,J)     -    PL ( I , J)*PL( I ,J)/NR)/NR) 


HE    FALLOW  I UG 


13X 


t     - 


IGM 
•  1T 
• DAL°HA« 

• tFlO.4,/,1 

• ,F10.4,/,' 
10,/) 
•OOUARTER1  ,19X,4(I10,5X)> 


PAPAMETFPS     hLP.h    USED    HOP    THIS    PUN:',/) 

' t F10.4, /t • _MU|i21Xt •'     ' tF10.4f/,«     5TGMA' 


NUMBER 
PEGFDER 


f-     REPLICATIONS    =     •,110,/,'     P!SK't 
LFVELSIOX,1*     •fF10.4,/tl     ISEED#,18X, 


210    T    R 
i        i 

2     l 

3  5 

4  4 

WF  T 
V«'y  I 
WL"  I 

Di 

wi  : 

1  (M 

2  , 
r>5    c;  N 

G'J 
Q99    STQ 
END 


MAT     { 

SAMPL 
•S 


4X 
X) 
(F 

TE 

TE 

TE 

^5 

TE 

SFFCI 

(PI  (I 

TINJE 

Tfl     10 

P 


/, 

0. 

(6 

(6 

(6 

I 

(6 


E    S.D. 

AMPLE 

•     •  ,  14 

4,5X), 

,200) 

,201) 

,202) 

=     lt7 

,210) 

,J),J= 

,J)  ,J  = 


TER* ,  19X,4(I  in, 5X1  ) 

HD',  13, 5X,  'SAMPLE    MEAT'     •  ,  4(  F10.4,  5X  )  *  /  ,  ■      'tlAX, 

•  ,4(F10.4,5X) ,/  ,'  •  ,14X,  »MSE«  ,9X,4(F10.4,5X  ),  /, •  •, 
RISK  ' ,4(F10.4,5X) ,/, •  ',14X,'S.O.  OF  P I S K • , 4( F10 .4 , 
X,  •REOPOEP' , 5X,4(F10.4,5X) ,/, •  •  ,  14X , • RE OPDE R  S.D.', 
/) 

ALPHA,MU,SIGMA,MR, R HO , TRL ,  I  SEED 
(MP(  I)  ,1*1,4) 

I,(SM(!,J),J=1,4),(SSD(I,J),J=1,4), 
1,4),(SP(I,J),J=1,4),(SRD(I,J),J=1,4) 
1,4),(PLSD(I ,J) , J=l,4) 
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APPENDIX  B  -  Forecasts  of  Mean  Demand 
This  program  consists  of  both  a  demand  generator  and  a 
forecast  analyzer.   In  the  generator,  normally  distributed  demand 
is  first  generated  and  then  transformed  into  the  five  patterns 
outlined  in  Section  3.   In  the  analyzer,  each  of  the  four  forecast 
methods  outlined  in  Section  3  is  tested  against  all  five  demand 

patterns.   For  the  two  smoothing  techniques,  the  usual  relation- 

+ 

ship 

f.  ,,  =  (l-a)f.  +  ax. 
l+l         l      i 

was  used.   For  maximum  likelihood  it  was  assumed  that  demands  had 
been  recorded  for  20  periods  prior  to  the  initial  testing  period 
and  that  the  20  period  average  coincided  with  the  parameter  mean 
used  in  the  generator.   For  the  eight  quarter  moving  average, 
eight  extra  quarters  of  demand  were  first  generated  for  a  set  of 
initial  conditions  whereupon  the  relationship 

(xi-l~xi-9} 

f.  =  f.  ,  + 


i     i-1        8 

was  used  to  forecast.   The  program  follows. 

|.      iokAM  COMPARES  VARIOUS  TECHNIQUES  FQK  FORECASTING  DEMAND. 

I.       >FE  aNU  MEAN  RANK  AKf-  CUMPUTL-D  FUR  fcALH.   VARluUS  NON-S  TAT  I  UN  ARY 

I.     MhAN  iMORMALLY  DISTRIBUTED  UEH'VNI)  PATTERNS  APE  CONSIDERED. 

u  DATA  INPUTS:   MU  CC   I- 10 

i  SI  UNA  ll-?0 

C  0E."  PATTERN     21j 

C      4t  CARD  WILL  KU^J  DEMAND  PATTERNS  FROn  OP  1  U  5 

L  NK  REPLICATIONS    '11-35 

NR    PERIODS  41-  **b 

i  ISEED  5l-Dt> 

C  PkOGhAH    TERMINATES    WHEN    NEGATIVF     MU     ENC- •UN  TERED . 

L  1 ECH  U wUEb    USED    ARE: 

L.        SS.l     (SINGLl      SMUUTHINJ     WITH     ALPHA     =     .1) 
C  ?.        SS.?     ISINGLF     SMOUTHING     WITH    ALPHA    =     .2) 

L  l,        MLE^O     I  MAX    LIKELIHOOD    AS  SUM  I  Ni,    20    glRb     PRIOR    EXISTENCE) 

C  4.         MAd     (8     (jTR     MuVlNb    AVtKAof) 

i  i\u;-s  \l*T  10NAR1  TY     IS    ATONED    Tu    COMMENCE     IN     PEKIOO     3. 

t  St 

f .,,   is  the  forecast  for  the   (i+1) —  period  using   x.   as  the 
most  recent  observation. 
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( 

I       M-  - 

1 

c. 

k  r  n  <n 

) 

1 

i'AT  i 

j 

'ATT  i  ><i\ 

4 

L 

i'  A  T  T ; 

) 

30  *     ^TtP     INCREASE 
10  0*    STF  P     INCREASE 
1J0-8     SP1KL 

1    )'.,     KA  -IP 

10*    UAMP    J    )K    c     *TRS, 


I  H  E  IS    l  i.  V  L  L 


<  t  ui.      -1   J 

]     jTLut     tv       !.)P 

!  J  1    -U   :>iS  H  IN     A  (  1  00  )  ,  Y  (  0  i    ,  r  {   1  00  »  ,  K  AIM*  <*  )  »  <F  Y  (  t  ) 
At  *   ;      iyjl  4  )  ,SJMl  'V)  iZlt)  ,  bFE 
100    f     kN-AT     I  2E10.4,  I5,:>(  5X,  15)  ,tlO  .4  J 
'LL     UVFLOW 
li     stAb    <5,100)    MU,SIGMA,DF,NK,N, ISO 

IK-     ( MU.L  T.O.  )     GO     TO    999 
II      ISLED    =     ISO 
INITIAL  I /.F     AkKAY^ 
1)0      12      i      =•     1,4 

•  ■  Jl<  II)     =    0  . 
SUM!  1  J     =    0. 

>  S  Q   (     1     )  =  0  . 

1  •     i,!1M  INUl 
:-   ,1N    MA  I  N    LOOP 
do    90     J    =     1  ,  NR 
L.i    i     '.ATE    u(  0, 1  )     Dt  MANDS 

CALL     N  OkMAL     <ISEFD,X,N) 
IKANJjFGKH     Mr\;>T     I  WO     L'J  b  E  k  V  A  T  I  GNS 
Ml)     =     Mu    +     S  lGMA*Xt  1 ) 
X ( 2)     =     MU    +     S  IGMA*X( I  ) 

•  •AT;      PREVICUS    d     JTRS     DEMAND     FOP     MOVING     AVEkAoF 
CALL    i\  IkMAL     (  ISLEDi  Yibl 
00     16     1     =     1,8 
Hi!      =     MU     ♦     SIGMA *Y  I  I  J 
1<-    CONTINUE 
ii'/j     SELt.CT     OEMANO    PATTEKN    AND     TRANSFORM    REMAINING    OEMANOS 
Gj    TO     (21,  22, 23, 24, 25)  , DP 
3  1     1     =    J  ,  N 

3  ll,MA*X  I  I  ) 


S  IGMA*X  I  I  ) 
3  IGMA*X ( 3) 


(  1-2  J  *0.  1  )*MU    *     S  1GMA*  ;  (  I  ) 

♦     SIGMA*X<3) 
f     S1GMa*XI I ) 


;■;(  I )    =    l .  t>*,Mu 

CUM 1  JUE 
GO    M     5  0 
0  2     ;      .-.  2     I    =    ?•  ,N 

MI)    =    2...)*mu 

I       I.  ]  T  I  N  U  E 

bU     Tu      3  0 
.13)     -     2. 0*MU 

,i       33     I     =    t,N 

X(  I  )     =     NO    +     3  lbMA*X (  1  ) 
j3    CONTINUE 

bU    To     jO 
?•*    0-  •    _>•+     1     -    3rN 

XI  I  )  ■  -     (1.0    *■ 

jh  continue 

GO    TO     5  0 
2  5    X(  ii     =     1  .  1*MU 

00     s'j     I     =    <ffN 

Ml]     =     1.2*MU 
i 5    (.    liMTINUE 

50    CPf TIMUE 

fND    DEMAND    GENERATOR;    BEGIN    FORECAST    ANALYZER 

techi ■roue,   l:     ss.i 
r(  i )    =  mu 

CEL1     =     <X( 1)     -    MU)*(X( 1)     -     MU) 
Sf F     =     SFE1 

nr    52    I    =   2,m 

F(I  )    =    0.9*F(I-1)     ♦    0.1*XU-1) 
Srt     =     SFF    +     (X(!  )     -    r (  T)  )**2 

1j2   c   r  tjmue 

Z(l)     =     SFC/N 
TFCI^  IQUE    2:       SS.2 

SFL    =     SFE1 

D!      54     T     =    2,N 

F( I  )    =    0.3*F(I-1 )     ♦    0.2*X( 1-1) 

SEE    =    SFF    ♦    (X( I )    -    f  ( I ) )**2 
5A    r\  r:TINUE 

1(2)    =    s  f  f /  r  : 
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L 


5  c 


58 


MLE20 
N 


(X( 


CH    UU^     3: 
SFE     =    SFE1 
Df     56     I     =    2, 
F(  I  )     -     (  ( LP. 

rr[        =       SFF      4 

Z(3)     =    SFF/N 
CHf  I  QUF    4:       mas 
YSUM    =    Y( 1 ) 
D!      53     I     =    2,  fl 
v  i'k    =    YSUM    + 
C    FT  IT  UF 
F(l)     =     YSUV8. 
c  f  L     -     <  X  (  L  )     - 
60     I     =     2,8 
F  (  I  )     -     F  (  I  - 1  ) 


I  )*F(  1-1)     *■    X(  I-i))/(  19.     +•     I  ) 


I  ) 


r <  r )  )**2 


Y(  I  ) 

F 

+     (X(I-l)     -    Y (  I -  1 )  ) / 8 . 0 


♦    (X(  I  )    -    F<  I))**2 


Sf  F    =     SFE 

Tir'UE 

T  f  (  N  .  LE  .  3  )  GO  TTJ 
r  ( 9 )  =  F  (  8  )  -»-  (X( 
FFF    =     SFE    +     (X(9) 

62     I     =     10,  N 

nn   =   Fd-i)   +   (X(i-i ) 


64 

3)     -Y(8II/B.I) 
F(9) )**2 


+     (XU  ) 


-    X( 1-9)  )/8.0 
F( I) )**2 


6  2 
64 


8  ft 


(Z,KEY,4) 

4 

PANMKFYC 


P9 

i  - 

C       n'' 
r       ;,n 

C        Ml 

r      c  •. 

C        r  A 


c  1 

°2 

C       f  U 

'  r  -.  n 


2«  1 

?  n  "5 

*_       -  - 

^  1  tj 


SFL    =    SFE 

continue 

Z(4)     -    SFF/N 

D'      86     I     =     1,4 

fi     •(  :  )     =     SUM  (I  )     +    Z(  I  ) 

?rrM  i )  =  sro<  r )  +  z(  j  )*zn  ) 

C"NT  !K|JE 

(  MPUTE  RANK 
0  88  I  =  1,4 
KFY(I)     =     I 

TIMUE 
CALL    SHSHRT 

n<     89    I    =    l, 

F/'KI^Ydll     =     PAMMKFYC!))     «■     I 
Cr  NTINUE 
C    NTIf UF 

0  MAIN    LOOP 

W    COMPILE    STATISTICS 

Or     92     I     =     1,4 
A\    k-Ar.H 

RAT  K(  I  )     =    PANK(  I  )  /MR 
MPl  F    MEAN     TF    MSFE*S 

Y( I )     =    SUM( I )/MR 
MPl  L    STAMDAFD    DEVIATION    OF    ^SFE'S 

VAC    =     (SSO(I)    -    SUM(  I  )*SUM(I  )/NR)/NR 

IF     (VA»     .LT.    0.0)     On    TO    600 

Z(  !  )    =    SORT    (VAR) 
TINUE 

tj   |T'  secti: 

F^FMAT     (•<)•,///////,»     PARAMETERS    USED    FG*     THIS    RUN:1,//,'     MU 
L       F10.4,/,'     SIGMA'  ,15X^10.4,/,'     DEMAND    PATTEPN  •  ,  6X  ,  I  1  0,  /, 
2       •     ^FDL  ICATIHMS' ,8X, I  10,/, •     P EP I GDS *,  1 3X , I  10 ,// ) 

FHPMAT     (  •OMETHCD1  ,  15X,  '^t'V  ,1  IX,  • WSFE*  ,8X,  • SAMPLE  ',  /,  16X,  • 

1  23X,  »STD    DEV  ,  /) 

F<  kMAt     ('OS  I6,4X,3F15.4) 

WPITE     (6,200)     *lijf  5IGMA,DP,NR,N 

V      TTf      (6,201) 

DC     210     I     =     1,4 

V '    1TF     (6,202)     I,RAMK(I  ),  Y(  I  )  ,Z(I  ) 


18X 


RANK' 


SO 


C;C   f, 


C   r  TiruE 

IF     (DP    ,EQ. 

HP    =    ijp    +     i 

Gi     TO    11 
FOFMAT     CI! 


5)    GO    tc     10 


HO,/, 'OSJM(  I  )     = 


ODFMANI)    PATTERN    =     •  ,110,/ 

TF     (6,250)     I ,SUM( I ) ,SSg(I ) ,DP,VAP 


• ,F15.6,/, '0SSU( 
OVAP     =     SE15.6,//) 


I )    =     • ,E15.6,/, 


Wi 

VAF  0.0 

Gf     ^r     91 

STr  P 
Ef  n 
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APPENDIX  C  -  Comparing  SPCC  Data 
The  assumptions  leading  to  an  initial  forecast  for  each  of 
the  forecasting  schemes  examined  were  discussed  in  Section  4. 
Once  these  are  given,  forecasting  then  proceeds  as  in  Appendix  B. 
In  connection  with  both  maximum  likelihood  and  moving  average, 
it  was  assumed  further  that  eight  previous  demands,  each  equal  to 
the  initial  forecast,  was  part  of  the  recorded  history.   Some 
assumption  of  this  nature  is  essential  for  the  computational  forms 
required.   These  matters  are  obvious  in  the  program  which  follows. 


C  COMPARES  4  FORECASTING  TECHNIQUES  USING  SPCC  DATA 

C  CONSIDERS  ITEMS  WHOSE  AVG  DEMAND  IS  BETWEEN  DL  AND  DH 

C  CSFEl=SS.l,CSf  E2=SS.2,CSFE3=MA8,CSPE4=MLE8 

C 

c 

REAL*4    SSL     (100^), SS2    (  IOC  0)  ,  v .AG  (  1C00)  ,  VLE  8(  1000  )  ,  X(  10  )  ,  Y{  10  ) 
INTEGER*4    A ( 10 ) , H ( 10 ) , D( 10 ,8 ) 
100    FORMAT     ( 10(2X,2A4,20X,8I 10 ,F 8. 2» F 7. 2 ) ) 
200    FM31AT     (lX,I5,2Xt2A4,8l4f2X,2r9.2t'tF15.4) 

300    FORMAT     (  1H  1  ,  4X  ,  •  N  •  ,  6X,  «NI  I  N»  ,2X  ,  •  DO  »  ,2  X,  •  Dl  •  ,  2X  ,  •  D2  •  ,  2X  ,  •  03  •  t  2X  , 
1        •DA' ,2X,  ' D5',2X,  •D6I  »2X,  »D7»  ,  7X, 'MEAN'  ,  6X,  '  VMR •  ,3X,  'SMOOTHING     .1 
21  tiXf •SMOOTHING    .2'f1     MOVING    AVERAGE »,  12X, • MLE  •  ) 
DATA    NR,F0,DL,DH/0,2.5,2.0,3.0/ 
CALL    EP.RSET     (215,300,-1,  1) 
WRI^b     (b,300) 
REWIND    2 
5    RFAD    (2,  100,EriD=20  )     (  (  A  (  I  )  ,  B (  I  )  ,  (  D(  I  ,  J  I  ,  J=  1,  8 )  ,  X  (  I  )  ,  Y(  I)  )  ♦  I  =  1 ,  10  ) 
DC     10    I     =     1,10 

IF     ((X(I).LT.DL    ).0P .(X( I) .GT.DH    ))     GO    To    10 
NR    =    NR    ♦    1 

CALL     FCST(D,SS1     ,SS2     , MAS , MLE8 , NR, I , F0 ) 

WPITE     (6,200)    MP  ,A(I  ),B(  I  )  ,(D(  I  ,  J)  ,  J  =  l,<3)  ,X(  !)  ,Y(I  )  ,SS1     (MR), 
1       SS2     (  JR)  ,MA8(NR) ,MLE8(Np ) 
IT     (NR.GT.1000)    GO    TV    20 
10    CONTINUE 

GO    TC    5 
20    CALL    HISTG(SS1    ,NP,0) 
CALL    HISTG(SS2    ,NR,0) 
CALL     H  I  STG  ( fiA8  ,r;F  ,0) 
CALL    HIbTC(MLE8,NR,C) 
STOP 
END 
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50 


52 


54 


5o 


SUBFOUTTUE    FCST(0, 

INTEGER*4    0(10,d) 

REAL*4  SSI  { 1000) , 

F  =  FO 

SFF1  =  (F  -  D( 1,8) )**2 

SS.l  FORECASTS 

SFE  =  Sf  El 

=  1.7 

K 

F  +  0.1-0(1 

E  +  (F  -  D< 

=  SFE 


SSltSS2f MA8f MLE8.NR1 
SSZ  (10( Q) ,MA8(1000) , 


i,ro) 

LE8(  LOO; 


K 


DO  50 

J  =  8  - 

F  =  0.9' 

SFE  =  Sf 

SSKNR) 

SS.2  FORECASTS 

F  =  FO 

SFE  =  SFF1 

DO    5  2  K  =  1,7 

=  8  —  K 
F  -    C.8-F  +  0.2*0(1 


J+l) 

,J ) >**2 


0(1 


SFE  =  SFE  +  <F  - 

SS2(NR )  =  SFE 

MAS  FORECASTS 

F  =  FO 

SFE  =  S  F  E 1 

DO  5  4  K  =  1,7 
-  P  _  1/ 

F  =  F  +  0.1 25*  (I)  (I,  J  +  l) 


J+l) 
,J))**2 


-  FO) 


SFE  =  SFE  +  (F 

MA8(NR)  =  SFE 
MLF3  FORECASTS 
F  =  FO 
SFE  =  SFE1 
00  5  6  K  =  1,7 
I  =  fi—  K 

F  =  ((K+7.0)*F 
SFE  =  SFE  +  (F 
MLE8  1NP)  =  SFE 
RETURN 
END 


-  D( 1 , J ) )**2 


D(T  ,J  +  1)  )/(K+8.0) 
D(I  ,J  )  )**? 
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APPENDIX  D  -  Computation  Times 
The  following  comparisons  are  based  on  processing  times 
for  an  IBM  360/65   computer  using  1968  technology.   For  newer 
large  computers,  such  as  the  Burroughs  3500  presently  installed 
at  Naval  Supply  Centers,  times  will  be  faster.   This  is  particu- 
larly true  for  division  and  square  root  operations.   All  times 

— ft 
reported  here  are  in  microseconds  (10    seconds) . 

The  summary  table  below  has  the  following  legend. 

A.  Exponential  Smoothing. 

B.  Maximum  Likelihood  (Mean) . 

C.  Moving  Average. 

D.  Exponentially  Smoothed  MAD. 

E.  Maximum  Likelihood  (Standard  Deviation). 

F.  Exponentially  Smoothed  Squared  Error. 

G.  Root  Mean  Squared  Forecast  Error. 

NUMBER  OF  OPERATIONS 


TIME  PER  OPERATION 

A 

B 

C 

D 

E 

F 

G 

Additions        (0.65) 

1 

2 

1 

1 

2 

1 

1 

Subtractions     (0.65) 

1 

0 

1 

1 

1 

1 

1 

Multiplications  (4.05) 

2 

0 

1 

3 

2 

4 

2 

Divisions        (6.55) 

0 

1 

0 

0 

2 

0 

1 

Absolute  Value   (0.95) 

1 

0 

0 

1 

0 

0 

0 

Square  Root      (59.1) 

0 

0 

0 

0 

1 

1 

1 

Total 

10.35 

7.85 

5.35 

14.40 

82.25 

76.60 

75.05 

Table  D.l.   Times  Versus  Operations  (Per  Iteration). 
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From  the  table  we  see  that  the  difference  in  processing 
time  for  the  various  methods  of  forecasting  mean  demand  (A,  B,  C) 
is  less  than  one  second  per  100,000  iterations.   For  estimators 
of  variability,  the  difference  is  less  than  seven  seconds  per 
100,000  iterations.   For  the  kinds  of  estimators  that  we  have  been 
discussing,  then,  processing  time  certainly  ought  not  to  be  an 
overriding  factor  in  choosing  one  method  over  another. 
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